Central limit theorem for the averaged Adam optimizer

In this article, we analyse convergence of the averaged Adam optimizer to an attracting zero of the Adam vector field. We provide a central limit theorem that, in particular, quantifies exactly the speed of convergence. The order of convergence is n^{-1/2} in the number of steps of the algorithm w…